on the safe side
being especially careful; taking no risks
I took some extra cash just to be on the safe side.